32 research outputs found

    Pairwise Element Computation with MapReduce

    Get PDF
    In this paper, we present a parallel method to evaluate functions on pairs of elements. It is a challenge to partition the Cartesian product of a set with itself in order to parallelize the function evaluation on all pairs. Our solution uses (a) replication of set elements to allow for partitioning and (b) aggregation of the results gathered for different copies of an element. Based on an execution model with nodes that execute tasks on local data without online communication, we present a generic algorithm and show how it can be implemented with MapReduce. Three different distribution schemes that define the partitioning of the Cartesian product are introduced, compared, and evaluated. Any one of the distribution schemes can be used to derive and implement a specific algorithm for parallel pairwise element computation

    Drift-Aware Ensemble Regression

    Get PDF
    Regression models are often required for controlling production processes by predicting parameter values. However, the implicit assumption of standard regression techniques that the data set used for parameter estimation comes from a stationary joint distribution may not hold in this context because manufacturing processes are subject to physical changes like wear and aging, denoted as process drift. This can cause the estimated model to deviate significantly from the current state of the modeled system. In this paper, we discuss the problem of estimating regression models from drifting processes and we present ensemble regression, an approach that maintains a set of regression models—estimated from different ranges of the data set—according to their predictive performance. We extensively evaluate our approach on synthetic and real-world data

    Clustering Uncertain Data with Possible Worlds

    Get PDF
    The topic of managing uncertain data has been explored in many ways. Different methodologies for data storage and query processing have been proposed. As the availability of management systems grows, the research on analytics of uncertain data is gaining in importance. Similar to the challenges faced in the field of data management, algorithms for uncertain data mining also have a high performance degradation compared to their certain algorithms. To overcome the problem of performance degradation, the MCDB approach was developed for uncertain data management based on the possible world scenario. As this methodology shows significant performance and scalability enhancement, we adopt this method for the field of mining on uncertain data. In this paper, we introduce a clustering methodology for uncertain data and illustrate current issues with this approach within the field of clustering uncertain data

    Small patches of riparian woody vegetation enhance biodiversity of invertebrates

    Get PDF
    Patches of riparian woody vegetation potentially help mitigate environmental impacts of agriculture and safeguard biodiversity. We investigated the effects of riparian forest on invertebrate diversity in coupled stream-riparian networks using a case study in the Zwalm river basin (Flanders, Belgium). Agriculture is one of the main pressures in the basin and riparian forest is limited to a number of isolated patches. Our 32 study sites comprised nine unshaded “unbuffered” sites which were paired with nine shaded “buffered” sites on the same stream reach, along with five ‘least-disturbed’ sites and nine downstream sites. We sampled water chemistry, habitat characteristics and stream and riparian invertebrates (carabid beetles and spiders) at each site. Three methods were used to quantify riparian attributes at different spatial scales: a visually-assessed qualitative index, quantitative estimates of habitat categories in six rectangular plots (10 × 5 m) and geographic information system (GIS)-derived land cover data. We investigated relationships between invertebrates and riparian attributes at different scales with linear regression and redundancy analyses. Spiders and carabids were most associated with local riparian attributes. In contrast, aquatic macroinvertebrates were strongly influenced by the extent of riparian vegetation in a riparian band upstream (100–300 m). These findings demonstrate the value of quantifying GIS-based metrics of riparian cover over larger spatial scales into assessments of the efficacy of riparian management as a complement to more detailed local scale riparian assessments in situ. Our findings highlight the value of even small patches of riparian vegetation in an otherwise extensively disturbed landscape in supporting biodiversity of both terrestrial and freshwater invertebrates and emphasize the need to consider multiple spatial scales in riparian management strategies which aim to mitigate human impacts on biodiversity in stream-riparian networks

    A Bayesian Belief Network learning tool integrates multi-scale effects of riparian buffers on stream invertebrates

    Get PDF
    Riparian forest buffers have multiple benefits for biodiversity and ecosystem services in both freshwater and terrestrial habitats but are rarely implemented in water ecosystem management, partly reflecting the lack of information on the effectiveness of this measure. In this context, social learning is valuable to inform stakeholders of the efficacy of riparian vegetation in mitigating stream degradation. We aim to develop a Bayesian belief network (BBN) model for application as a learning tool to simulate and assess the reach-and segment-scale effects of riparian vegetation properties and land use on instream invertebrates. We surveyed reach-scale riparian conditions, extracted segment-scale riparian and subcatchment land use information from geographic information system data, and collected macroinvertebrate samples from four catchments in Europe (Belgium, Norway, Romania, and Sweden). We modelled the ecological condition based on the Average Score Per Taxon (ASPT) index, a macroinvertebrate-based index widely used in European bioassessment, as a function of different riparian variables using the BBN modelling approach. The results of the model simulations provided insights into the usefulness of riparian vegetation attributes in enhancing the ecological condition, with reach-scale riparian vegetation quality associated with the strongest improvements in ecological status. Specifically, reach-scale buffer vegetation of score 3 (i.e. moderate quality) generally results in the highest probability of a good ASPT score (99-100%). In contrast, a site with a narrow width of riparian trees and a small area of trees with reach-scale buffer vegetation of score 1 (i.e. low quality) predicts a high probability of a bad ASPT score (74%). The strengths of the BBN model are the ease of interpretation, fast simulation, ability to explicitly indicate uncertainty in model outcomes, and interactivity. These merits point to the potential use of the BBN model in workshop activities to stimulate key learning processes that help inform the management of riparian zones

    Assessing the Benefits of Forested Riparian Zones: A Qualitative Index of Riparian Integrity Is Positively Associated with Ecological Status in European Streams

    Get PDF
    Developing a general, predictive understanding of ecological systems requires knowing how much structural and functional relationships can cross scales and contexts. Here, we introduce the CROSSLINK project that investigates the role of forested riparian buffers in modified European landscapes by measuring a wide range of ecosystem attributes in stream-riparian networks. CROSSLINK involves replicated field measurements in four case-study basins with varying levels of human development: Norway (Oslo Fjord), Sweden (Lake Malaren), Belgium (Zwalm River), and Romania (Arge River). Nested within these case-study basins include multiple, independent stream-site pairs with a forested riparian buffer and unbuffered section located upstream, as well as headwater and downstream sites to show cumulative land-use impacts. CROSSLINK applies existing and bespoke methods to describe habitat conditions, biodiversity, and ecosystem functioning in aquatic and terrestrial habitats. Here, we summarize the approaches used, detail protocols in supplementary materials, and explain how data is applied in an optimization framework to better manage tradeoffs in multifunctional landscapes. We then present results demonstrating the range of riparian conditions present in our case-study basins and how these environmental states influence stream ecological integrity with the commonly used macroinvertebrate Average Score Per Taxon (ASPT) index. We demonstrate that a qualitative index of riparian integrity can be positively associated with stream ecological status. This introduction to the CROSSLINK project shows the potential for our replicated study with its panoply of ecosystem attributes to help guide management decisions regarding the use of forested riparian buffers in human-impacted landscapes. This knowledge is highly relevant in a time of rapid environmental change where freshwater biodiversity is increasingly under pressure from a range of human impacts that include habitat loss, pollution, and climate change

    The Near Infrared Imager and Slitless Spectrograph for the James Webb Space Telescope -- IV. Aperture Masking Interferometry

    Full text link
    The James Webb Space Telescope's Near Infrared Imager and Slitless Spectrograph (JWST-NIRISS) flies a 7-hole non-redundant mask (NRM), the first such interferometer in space, operating at 3-5 \micron~wavelengths, and a bright limit of ≃4\simeq 4 magnitudes in W2. We describe the NIRISS Aperture Masking Interferometry (AMI) mode to help potential observers understand its underlying principles, present some sample science cases, explain its operational observing strategies, indicate how AMI proposals can be developed with data simulations, and how AMI data can be analyzed. We also present key results from commissioning AMI. Since the allied Kernel Phase Imaging (KPI) technique benefits from AMI operational strategies, we also cover NIRISS KPI methods and analysis techniques, including a new user-friendly KPI pipeline. The NIRISS KPI bright limit is ≃8\simeq 8 W2 magnitudes. AMI (and KPI) achieve an inner working angle of ∌70\sim 70 mas that is well inside the ∌400\sim 400 mas NIRCam inner working angle for its circular occulter coronagraphs at comparable wavelengths.Comment: 30 pages, 10 figure

    A global agenda for advancing freshwater biodiversity research

    Get PDF
    Global freshwater biodiversity is declining dramatically, and meeting the challenges of this crisis requires bold goals and the mobilisation of substantial resources. While the reasons are varied, investments in both research and conservation of freshwater biodiversity lag far behind those in the terrestrial and marine realms. Inspired by a global consultation, we identify 15 pressing priority needs, grouped into five research areas, in an effort to support informed stewardship of freshwater biodiversity. The proposed agenda aims to advance freshwater biodiversity research globally as a critical step in improving coordinated actions towards its sustainable management and conservation

    A global agenda for advancing freshwater biodiversity research

    Get PDF
    Global freshwater biodiversity is declining dramatically, and meeting the challenges of this crisis requires bold goals and the mobilisation of substantial resources. While the reasons are varied, investments in both research and conservation of freshwater biodiversity lag far behind those in the terrestrial and marine realms. Inspired by a global consultation, we identify 15 pressing priority needs, grouped into five research areas, in an effort to support informed stewardship of freshwater biodiversity. The proposed agenda aims to advance freshwater biodiversity research globally as a critical step in improving coordinated actions towards its sustainable management and conservation.Peer reviewe

    The Science Performance of JWST as Characterized in Commissioning

    Full text link
    This paper characterizes the actual science performance of the James Webb Space Telescope (JWST), as determined from the six month commissioning period. We summarize the performance of the spacecraft, telescope, science instruments, and ground system, with an emphasis on differences from pre-launch expectations. Commissioning has made clear that JWST is fully capable of achieving the discoveries for which it was built. Moreover, almost across the board, the science performance of JWST is better than expected; in most cases, JWST will go deeper faster than expected. The telescope and instrument suite have demonstrated the sensitivity, stability, image quality, and spectral range that are necessary to transform our understanding of the cosmos through observations spanning from near-earth asteroids to the most distant galaxies.Comment: 5th version as accepted to PASP; 31 pages, 18 figures; https://iopscience.iop.org/article/10.1088/1538-3873/acb29
    corecore